<html>
<head><meta charset="utf-8"><title>CI dependencies · t-infra · Zulip Chat Archive</title></head>
<h2>Stream: <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/index.html">t-infra</a></h2>
<h3>Topic: <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html">CI dependencies</a></h3>

<hr>

<base href="https://rust-lang.zulipchat.com">

<head><link href="https://rust-lang.github.io/zulip_archive/style.css" rel="stylesheet"></head>

<a name="202110774"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202110774" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Manish Goregaokar <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202110774">(Jun 26 2020 at 16:15)</a>:</h4>
<p><span class="user-mention" data-user-id="121055">@Pietro Albini</span> So Servo's CI has a bunch of things I wish we could have here. This is worth bringing up in any discussions with GitHub/Azure you may have</p>



<a name="202110805"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202110805" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202110805">(Jun 26 2020 at 16:15)</a>:</h4>
<p>hm?</p>



<a name="202110817"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202110817" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Manish Goregaokar <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202110817">(Jun 26 2020 at 16:15)</a>:</h4>
<p>hold on writing them down</p>



<a name="202110847"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202110847" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Manish Goregaokar <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202110847">(Jun 26 2020 at 16:15)</a>:</h4>
<p>Firstly, our build pipeline is an actual pipeline: we spin off jobs for linux debug/release mac debug/release, etc, and _then_ spawn multiple CI jobs that depends on the builds to run various tests</p>



<a name="202110893"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202110893" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Manish Goregaokar <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202110893">(Jun 26 2020 at 16:16)</a>:</h4>
<p>I _think_ github actions has support for this</p>



<a name="202110910"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202110910" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Manish Goregaokar <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202110910">(Jun 26 2020 at 16:16)</a>:</h4>
<p>but it basically means we never build stuff twice</p>



<a name="202111150"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202111150" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Manish Goregaokar <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202111150">(Jun 26 2020 at 16:18)</a>:</h4>
<p>secondly, successful build results, including artifacts, are cached for a while. if, for example, i'm testing a PR, and it fails. retrying the PR (with the same master branch) will only retry the builds that had failed or not completed, because taskcluster sees that the "inputs" are the same (merge hash, etc) and finds existing objects for a lot of them</p>



<a name="202111194"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202111194" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Manish Goregaokar <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202111194">(Jun 26 2020 at 16:18)</a>:</h4>
<p>this pairs with the "never build stuff twice" -- if a test fails and you retry the same PR, the build is fetched from the cached object</p>



<a name="202111212"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202111212" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Manish Goregaokar <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202111212">(Jun 26 2020 at 16:18)</a>:</h4>
<p>bth of these seem like nice properties to have</p>



<a name="202111235"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202111235" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Manish Goregaokar <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202111235">(Jun 26 2020 at 16:19)</a>:</h4>
<p>we use taskcluster to get this, but it might be somethng we can build directly</p>



<a name="202111669"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202111669" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202111669">(Jun 26 2020 at 16:22)</a>:</h4>
<p>sooo</p>



<a name="202111773"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202111773" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202111773">(Jun 26 2020 at 16:23)</a>:</h4>
<p>using actual pipelines is going to be a pain due to a limitation of github actions</p>



<a name="202111998"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202111998" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202111998">(Jun 26 2020 at 16:25)</a>:</h4>
<p>basically the limit of 60 parallel builders is hardcoded, and it can't be increased further for our organization</p>



<a name="202112020"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202112020" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202112020">(Jun 26 2020 at 16:25)</a>:</h4>
<p>and the solution they have right now is to run the build across multiple organizations</p>



<a name="202112045"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202112045" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202112045">(Jun 26 2020 at 16:25)</a>:</h4>
<p>so using pipelines would possibly break as soon as we add a couple extra builders</p>



<a name="202112166"></a>
<h4><a href="https://rust-lang.zulipchat.com#narrow/stream/242791-t-infra/topic/CI%20dependencies/near/202112166" class="zl"><img src="https://rust-lang.github.io/zulip_archive/assets/img/zulip.svg" alt="view this post on Zulip" style="width:20px;height:20px;"></a> Pietro Albini <a href="https://rust-lang.github.io/zulip_archive/stream/242791-t-infra/topic/CI.20dependencies.html#202112166">(Jun 26 2020 at 16:26)</a>:</h4>
<p>and avoiding to build stuff twice... I'm not sure it's worth the effort</p>



<hr><p>Last updated: Aug 07 2021 at 22:04 UTC</p>
</html>